Tags: #tech, #software

Backlinks: 

Created: 2026-08-04 06:29
Last edited: 2026-08-04 06:29

Browsertrix Crawler

standalone crawling software that can write WACZ files

can be useful to manually archive web pages when the archive.org crawler is blocked

web

• https://github.com/webrecorder/browsertrix-crawler/

usage

• get: # docker pull webrecorder/browsertrix-crawler
• run: # docker run -v $PWD/crawls:/crawls/ -it webrecorder/browsertrix-crawler crawl --url <url> --generateWACZ --collection <name> --scopeType page-spa
• Share manually crawled web page online